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J.^ , Abstract. In this paper, we determine all irreducible spherical functions <3> 

of any K-type associated to the pair (G,K) = (SO(4), SO(3)). This is ac- 
complished by associating to <E> a vector valued function H = H(u) of a real 
variable u, which is analytic at u = and whose components are solutions of 

Q\ , two coupled systems of ordinary differential equations. By an appropriate con- 

jugation involving Hahn polynomials we uncouple one of the systems. Then 
this is taken to an uncoupled system of hypergeometric equations, leading to a 
vector valued solution P = P(u) whose entries are Gegenbauer's polynomials. 

■^^ Afterward, we identify those simultaneous solutions and use the representa- 

tion theory of SO(4) to characterize all irreducible spherical functions. The 
functions P = P(u) corresponding to the irreducible spherical functions of 
C"| a fixed K-type n£ are appropriately packaged into a sequence of matrix val- 

ued polynomials {Pw)w>0 of size [i + 1) X (£ + 1). Finally we proved that 
Pw = Po~ 1 Pw is a sequence of matrix orthogonal polynomials with respect 
to a weight matrix W. Moreover we showed that W admits a second order 
symmetric hypergeometric operator D and a first order symmetric differential 

operator E. 

i— i . 

> 

in 

CN . 1. Introduction 

^J ■ The theory of spherical functions dates back to the classical papers of E. Cartan 

f—v I and H. Weyl; they showed that spherical harmonics arise in a natural way from the 

£vQ ' study of functions on the n-dimensional sphere S n = SO(n + 1)/S0(n). The first 

general results in this direction were obtained in 1950 by Gelfand who considered 
zonal spherical functions of a Riemannian symmetric space G/K. In this case we 
have a polar decomposition G = KAK. When the abelian subgroup A is one 
dimensional the restrictions of zonal spherical functions to A can be identified with 
hypergeometric functions, providing a deep and fruitful connection between group 
representation theory and special functions. In particular when G is compact this 
gives a one to one correspondence between all zonal spherical functions of the 
symmetric pair (G, K) and a sequence of orthogonal polynomials. 

In light of this remarkable background it is reasonable to look for an extension 
of the above results, by considering matrix valued spherical functions on G of a 
general if -type. This was accomplished for the first time in the case of the complex 
projective plane ^(C) = SU(3)/U(2) in [GPT2J . This seminal work gave rise 
to a series of papers including |GPT1| IGPT4| IGPT6| |PTT| IPT2] IPRJ . where one 
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considers matrix valued spherical functions associated to a compact symmetric 
pair (G 1 K) 1 arriving at sequences of matrix valued orthogonal polynomials of one 
real variable satisfying an explicit three term recursion relation, which are also 
eigenfunctions of a second order matrix differential operator (bispectral property). 
In particular in [G] the first example of a matrix weight function on the real line 
with a symmetric matrix second order differential operator was exhibited. Related 
results can be also found in |GPT5| lPTJ~T| IgT I IUt I IRT2] . In JPT12] the irreducible 
spherical functions associated to the complex projective space P„(C) of a given K- 
type are encoded in a sequence of matrix valued orthogonal polynomials, which are 
given in terms of the matrix hypergeometric function. The three term recursion 
relation was obtained in [P j and the corresponding semi infinite matrix turns out to 
be stochastic. This unexpected result leads to the study of the random walk with 
this transition probability matrix, see [GPT7J . 

A different approach to find examples of classical matrix orthogonal polynomials 
can be found in |DGj . 

The present paper is an outgrowth of [Z] and we are presently working on the 
extension of the present results to the n-dimensional sphere and the n-dimensional 
real projective space. 

Briefly the main results of this paper are the following. After a preliminary work 
developed along the first sections, in Section [5] we are able to explicitly describe 
the irreducible spherical functions of the symmetric pair (SO(4), SO(3)) of a fixed 
-RT-type, by a vector valued function P = P(u) whose entries are certain Gegen- 
bauer polynomials in a suitable variable u. This is accomplished by uncoupling a 
system of second order linear differential equations using a constant matrix of Hahn 
polynomials evaluated at 1, see Corollary 15.51 

In Section [7] it is established which are those vector valued polynomials P = 
P(u) who correspond to irreducible spherical functions, and it is shown how to 
reconstruct the spherical functions out of them. 

The aim of the last two sections is to build classical sequences of matrix valued 
orthogonal polynomials from our previous work. In Section[5]we defined a sequence 
of polynomial matrices P Wl w > 0, whose columns are the vector valued polynomials 
P = P(u) corresponding to some specific irreducible spherical functions of the same 
ii'-type. Then we consider the sequence P w = Pq~ P w and we prove that (P w )w>o 
is a sequence of matrix orthogonal polynomials with respect to a weight function 
explicitly given in (|60[) . Moreover the matrix differential operators D and E given 
in Theoren 18.31 satisfy DP W = P W K W and EP W = P W M W , where the eigenvalue 
matrices A„, and M w are real diagonal matrices. Thus D and E are symmetric 
with respect to W. 



2. Preliminaries 

2.1. Spherical functions. 

Let G be a locally compact unimodular group and let K be a compact subgroup 
of G. Let K denote the set of all equivalence classes of complex finite dimensional 
irreducible representations of K; for each 5 £ K, let £g denote the character of 5, 
d(S) the degree of S, i.e. the dimension of any representation in the class d, and 
Xs = d(S)£s- We shall choose once and for all the Haar measure dk on K normalized 
by ! K dk= 1. 
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We shall denote by V a finite dimensional vector space over the field C of com- 
plex numbers and by End(V) the space of all linear transformations of V into V. 
Whenever we refer to a topology on such a vector space we shall be talking about 
the unique Hausdorff linear topology on it. 

Definition 2.1. A spherical function $ on G of type 6 G K is a continuous function 
on G with values in End(V) such that 

i) $(e) = I (1= identity transformation). 

ii) $(x)$(y) = f K xs(k~ 1 )$(xky)dk, for all x,y G G. 

The reader can find a number of general results in |Tir77j and [GV88 . For our 
purpose it is appropriate to recall the following facts. 

Proposition 2.2. ( [Tir77j ■ [GV88] ) If § : G — > End(V) is a spherical function of 
type 5 then: 

i) 3>(kgk') = $(fc)$( 5 )$(&'), for all k,k' €K, g£ G. 

ii) k h-> $(fc) is a representation of K such that any irreducible subrepresenta- 
tion belongs to 5. 

Concerning the definition let us point out that the spherical function $ deter- 
mines its type univocally ( Proposition 12. 2} and let us say that the number of times 
that 6 occurs in the representation k i— > <&(/c) is called the height of $. 

If G is a connected Lie group it is not difficult to prove that any spherical 
function $ : G — > End(V^) is differcntiable (C°°), and moreover that it is analytic. 
Let D(G) denote the algebra of all left invariant differential operators on G and let 
D(G) K denote the subalgebra of all operators in D(G) which are invariant under 
all right translations by elements in K. 

In the following proposition (V, w) will be a finite dimensional representation of 
K such that any irreducible subrepresentation belongs to the same class S € K. 

Proposition 2.3. ^ [Tir77j . [GV88] ) A function $ : G — ► End(V) is a spherical 
function of type 5 if and only if 
i) $ is analytic. 

ii) $(kigk 2 ) = n(k 1 )^(g)Tr(k 2 ), for all kx,k 2 £ K, g € G, and $(e) = /. 

iii) [D$}(g) - *(0)[D$](e), for all D e D(G) K , g G G. 

Moreover, we have that the eigenvalues [£)$](e), D £ D(G) K , characterize the 
spherical functions <& as it is stated in the following proposition. 

Proposition 2.4. i TLir77] . [GV88] ) Let $,* : G — > End(F) be two spherical 
functions on a connected Lie group G of the same type 8 G K . Then $ = ^ if and 
only if {D<t){e) = (D*)(e) for all D e D(G) K . 

Let us observe that if $ : G — > End(y) is a spherical function then $:Dh 
[D$](e) maps D(G) K into EndK(V) (End^(y) denotes the space of all linear maps 
of V into V which commutes with n(k) for all k G K) defining a finite dimensional 
representation of the associative algebra D(G) K . Moreover the spherical function is 
irreducible if and only if the representation $ : D(G) K — > End^ (V) is irreducible. 
As a consequence of this we have: 

Proposition 2.5. ^ |Tir77j . [GV88] ) The following properties are equivalent: 
i) D(G) K is commutative. 
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ii) Every irreducible spherical function of (G, K) is of height one. 

In this paper the pair (G, K) is (SO(4), SO(3)). Then it is known that D(G) K is 
an abelian algebra; moreover D(G) K is isomorphic to D{G) G ®D(K) K (cf. |Coo75j . 
|Kno86j ) . where D(G) G (resp. D{K) K ) denotes the subalgebra of all operators in 
D(G) (resp. D{K)) which are invariant under all right translations by elements in 
G (resp. K). 

Now, in our case we have that D(G) G is a polynomial algebra in two algebraically 
independent generators. This is because the Lie algebra of G isso(4) ~ so(3)©so(3), 
hence if Ai and A2 are the Casimirs of the corresponding so(3) we have that Ai 
and A2 generate D(G) G . 

The first consequence of this is that all irreducible spherical functions of our 
pair (G, K) are of height one. The second consequence is that to find all irreducible 
spherical functions of type 5 G K is equivalent to take any irreducible representation 
(V, it) of K in the class 6 and to determine all analytic functions $ : G — > End(V) 
such that 

i) §(kigk 2 ) = 7r(fci)$(#)7r(fc 2 ), for all k\, k 2 G K, g G G, and $(e) = I. 
ii) [Ai$](g) = A$(#), [A 2 $](sO = /MKflO for all 5 G G and for some A, p, G C. 
A particular choice of these operators Ai and A 2 is given in ((2J. 

Spherical functions of type S arise in a natural way upon considering represen- 
tations of G If g 1— > U(g) is a continuous representation of G, say on a finite 
dimensional vector space E, then 

Ps= I xs{k~ l )U{k)dk 

JK 

is a projection of E onto P$E = E(S). The function $ : G — > End(E(S)) defined 

by 

$(g)a = P 5 U(g)a, g£G,a£E(5), 

is a spherical function of type S. In fact, if a G -E(<5) we have 



*(a;)*(y)a = P s U(x)P 5 U(y)a = / X s{k-')P s U{x)U{k)U{y)adk 

J K 

Xs(k~ 1 )$(xky) dk ) a. 



'K J 

If the representation g 1— ► f (g) is irreducible then the associated spherical func- 
tion $ is also irreducible. Conversely, any irreducible spherical function on a com- 
pact group G arises in this way from a finite dimensional irreducible representation 
of G. 

2.2. The groups G and K. 

The three dimensional sphere 5* 3 can be realized as the homogeneous space G/K, 
where G = SO(4) and K = SO(3), where as usual we identify SO(3) as a subgroup 
of SO(4): for every k in K, let k = ( § ?) G G. 

It is well known that there exists a double covering Lie homomorphism SO(4) — > 
SO(3) x SO(3), in particular so(4) ~ so(3) © so(3). Explicitly it is obtained in the 
following way: Let q : SO(4) — > GL(A 2 (]R 4 )) be the Lie homomorphism defined 

by 

q(g)(ei A ej) = g(ei) A g(ej) , g G SO(4) , 1 < i < j < 4, 
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where {ej} 4 =1 is the canonical basis of M. 4 . Let q : so(4) — > g[(A 2 (R 4 )) denote the 
corresponding differential homomorphism. 

We observe that A 2 (M 4 ) is reducible as G- module. In fact we have the following 
decomposition into irreducible G- modules, A 2 (M 4 ) = V\ © V2, where 

V\ = span{e! A 64 + e 2 A e 3 , e\ A e 3 — e 2 A €4, —e\ A e 2 — e 3 A e 4 }, 

V2 = span{e! A €4 — e 2 A e 3 , e\ A e 3 + e 2 A e4, — ei A e 2 + e 3 A 64}. 

Let Pi and P 2 be the canonical projections onto the subspaces V\ and V 2 , respec- 
tively. The functions defined by 

a{g) = Piq(g)\ Vl , b{g) = P 2 q(g)\ v 2 , 

are Lie homomorphisms from SO(4) onto SO(Vi) ~ SO(3) and SO(V 2 ) ~ SO(3), 
respectively. Therefore in an appropriate basis we have, for each g G SO (4) and for 
all X <= so(4) 



(1) 



9(5) 



0(5) 

b(g) 



q{X) 



a(X) 
b(X) 



Hence, we can consider q as a homomorphism from SO(4) onto SO(3) x SO(3) 
with kernel {/, — /}. Besides it can be proved that a(g) = b(g) if and only if g <G K . 

2.3. The Lie algebra structure. 

A basis of g = so (4) over M. is given by 



ii = 



Ya 



Consider the following vectors 



" 10 0" 
-10 

oooo 

. 000. 


, Y 2 = 


" 10" 

oooo 

-10 

. 00. 


, Y 3 = 


ro oo"i 
0010 
0-100 

.0 00. 


1 000 

oooo 
oooo 

OOOh 


, Y 5 = 


ro oo" 
0001 
oooo 

0-100 


, Y^ = 


ro on 
oooo 
0001 
00-10 



i = ^(^ + Y 4 ) , 


z 2 -- 


-\(Y2-Y 5 ), 


Z3-- 


-\(Y 1 + Y e 


4 = \ <y 3 - y 4 ) , 


z 5 -- 


= \(Y2 + Y 5 ), 


z e = 


-\&-y* 



It can be proved that these vectors define a basis of so (4) adapted to the decom- 
position so(4) ~ so(3) ©so(3), i.e. {Z4, Z$, Zq} is a basis of the first summand and 
{Zi, Z 2 , Z 3 } is a basis of the second one. 

The algebra D(G) G is generated by the algebraically independent elements 



(2) 



Ai 



-Z 



Z 



6 > 



A 2 



■zi - zi 



which are the Casimirs of the the first and the second so (3) respectively. The 

r 3 



Casimir of K will be denoted by Ak, and it is given by — Y 2 — Y% — Y 3 2 



The complcxification of t, is isomorphic to st(2, C). If wc define 

/ i -1\ / » 1\ 7 /0 \ 

(3) e — [ -i , f = [ -i h = -2i 

' V 1 / V-i 0/ Vo 2* / 

then we have that {e, /, h} is an s-triple in tc, i.e. 

[e,f\=h, [h,e]=2e, [hj] = -2f. 
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H = 



We take as a Cartan subalgebra f)c of so(4,C) the complexification of the max- 
imal abelian subalgebra of so (4) of all matrices of the form 

/ xi 0\ 
-xx 

22 

\ -x 2 0/ 
Let £j <E [)£ be given by Ej(H) = —ixj for j = 1, 2. Then 

A(g c , f)c) = { ±(ei ± £2) : £1, £2 e f)c } , 

and we choose as positive roots those in the set A + (gc, f)c) = {£1 — £2, £1 + £2}- 
We define 

/ 1 -i\ I 1 i\ 



X, 





-1 



-i -1 
i 



(4) 



1 



-^£1— £2 



x_ 



£l+£2 



-A 





■1 



1 ^ — El— £2 




-1 



-« 
i 
-1 






— i 
1 



-1 



0/ 



/ 
? 1 

-1 -i 
\i -10 0/ 

Then, for every H in f)c we get that 

[H, -X"±( ei ±e 2 )] = ±(£l ± £2)(^)^±( £l ±e 2 )- 

Hence, each X±r El ± E3 -\ belongs to the root-space 0±( ei ± £2 ). 

Then, in terms of the root structure of so(4,C), Ai and A 2 become 

Ai = -Zl + iZ 6 - {Z 5 + iZ 4 )(Z 5 - iZ 4 ), 



1 
1 


<V 



(5) 

We observe that (Z 5 
and Z 3 ,Z 6 g fjc- 



A 2 = -Zl + iZ 5 - (Z 2 + iZ x )(Z 2 - %Z X ). 

iZ 4 ) = X E1 _ E2 e Qei-e2 and ( z 2 -iZ 1 ) = X E1 _ 



2.4. Irreducible representations of G and K. 

Let us first consider SU(2). It is well known that the irreducible finite dimen- 
sional representations of SU(2) are, up to equivalence, (71^, Vt)i>$, where Vg is the 
complex vector space of all polynomial functions in two complex variables z\ and 
z-i homogeneous of degree £, and 717 is defined by 

-1 



K( 



P 




for 



G SU(2). 



Hence, since there is a Lie homomorphism of SU(2) onto SO(3) with kernel {±/}, 
the irreducible representations of SO(3) corresponds to those representations irg 
of SU(2) with I e 2Z> . Therefore we have SO(3) = {[7T£]}^ 6 2Z>o, even more, if 
ix = Tig is any such irreducible representation of SO (3) , it is well known (see |Hum72| , 
page 32) that there exists a basis B — {vj} j =0 of V„ such that the corresponding 
representation -k of the complexification of so (3) is given by 

7r(% J = (^-2j> i , 

n(e)vj = (t-j + l)vj-i, (w-i=0), 

Hf) v j = U + l)«i+i. ( v e+i = °)- 
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It is known (see jVKj . page 362) that an irreducible representation r 6 SO(4) 
has highest weight of the form r\ — miei+m,2e2, where mi and m 2 are integers such 
that toi > \m%\. Moreover, the representation r = Tr mim2 \, restricted to SO(3), 
contains the representation 717 if and only if 

mi > § > \m 2 \. 

2.5. if-orbits in G/K. 

The group G = SO (4) acts in a natural way in the sphere S 3 . This action is 
transitive and K is the isotropy subgroup of the north pole e± = (0,0,0, 1) G 5 3 . 
Therefore S 3 ~ G/K. Moreover the G-action on S 3 corresponds to the action 
induced by left multiplication on G/K. 

In the north hemisphere of S 3 

(S 3 ) + = { x = (xi, x 2 , x 3 , Xi) e S 3 : x 4 > } , 
we will consider the coordinate system p : (5' 3 ) + — > K 3 given by 

(6) p(x) =(—,—,— )= (j/l,t/2,J/3). 

V X4 IE4 X4 / 





The coordinate map p carries the if-orbits in (5 3 ) + into the if-orbits in R 3 
which are the spheres 

S r = { (2/1, 2/2,2/3) G M 3 : ||?y|| 2 = |yi| 2 + |y 2 | 2 + \y 3 \ 2 = r 2 } , < r < 00. 

In each orbit 5 r we choose as a representative the point (r, 0, 0) 6 I 3 with < r < 
00. Then the interval [0, 00) parameterizes the set of X-orbits of M 3 . 

2.6. The auxiliary function $„-. 

As in [GPT2] to determine all irreducible spherical functions $ of type it = irg E 
K an auxiliary function ^ : G — > End(VJr) is introduced. In this case it is defined 

by 

* w (flf) = 7r(o(flf)), ff€G, 

where a is the Lie homomorphism from SO(4) to SO(3) given in ([1]). It is clear that 
<!>„- is an irreducible representation of SO (4) and hence a spherical function of type 
7r (see Definition 12. 1[) . 

3. The differential operators D and E 

To determine all irreducible spherical functions on G of type ir E K, is equivalent 
to determine all analytic functions $ : G — > End (14- ) such that 

i) §(k 1 gk 2 ) = 7r(fci)<J>(g)7r(fc 2 ), for all fci, fe G if, .g G G, and $(e) = i". 
ii) [Ai$](flf) = A$(g>), [A 2 $](s) = /^(s) for all 5 e G and for some A, ju G C. 
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Instead of looking at an irreducible spherical function $ of type it, we use the 
auxiliary function $„• to look at the function H : G — > End(V^) defined by 

(7) H(g) = $(.g)^(.g)- 1 . 

Observe that H is well defined on G because 3V is a representation of G. This 
function H , associated to the spherical function $, satisfies 

i) H(e) = I. 

ii) H{gk) = H(g), for all g e G, k e K. 
iii) H(kg) = 7 r(A:)i?(. 9 )7r(fc- 1 ), for all g e G, fc e K. 

The fact that $ is an eigenfunction of Ai and A 2 makes the function H into an 
eigenfunction of certain differential operators D and E on G to be determined now. 
Let us define 

(8) D(H) = Y 4 2 (H) + Y£(H) + Y*(H), 

(9) E(H) = (-Y i (H)Y 3 (^) + Y 6 (H)Y 2 (^)-Y 6 (H)Y 1 (^))^- 1 . 

Proposition 3.1. For any H <G C°°(G) End(V^) right invariant under K , the 
function $ = H^ n satisfies Ai$ = A$ and A 2 $ = ji& if and only if H satisfies 
DH = XH and EH = \xK, with 

A=-4A, n = -\£(£ + 2) + Ji-\. 

Proof. First we observe that Z 4 {$n) = Z^i^b^) = Ze(^„) = 0, because ^V is a 
representation of G and a{Zj) = for j = 4, 5, 6. In fact 

2»(**)(s) = || t=0 [* ff (5)* ff (exptZ,-)] = $ 7r ( 5 )7r(a(^)) = 0. 

On the other hand, since H is right invariant under K, we have that Yi(H) = 
Y 2 (H) = Y 3 (H) = 0. Since [Y 3 ,Y 4 ] = 0, [^2,^5] = and [Yi,Y 6 ] =0we have that 
Z?(#) = ^/(iJ), for j = 4, 5, 6. Therefore we obtain 

AiOff^) = -^Tz^H)^ = -\JZ Y ^ H )^ = -\d(H)*„. 

On the other hand we have 
3 

3=1 

Observe that Z^H) = ±y 4 (#)- Since Z 1 =Y 3 - Z 4 we have Zi($ ff ) = Y 3 (& n ) and 
Z\{<&^) = i^j 2 ($„■). Similar results holds for Z 2 and Z 3 . Therefore 

a 2 (#$ t ) = ~{zl(H) $ w + r 4 (#)r 3 ($,r) + mf(^)) 

- (z|(F) $ w - F 5 (F)y 2 ($ ff ) + ffr 2 2 ($.)) 

- (Z|(F) $ ff + ^(tf)^*,,) + HY?{ $ w )) 

= -^D(fl-) $„ + £(F) $v + tf A K ($,) 
= - ^D(fl-) $ w + E(H) $„. + H^tt(A k ). 
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Since Ak € D(G) K Schur's Lemma tells us that tt(Ak) = cl. Now we have 
Ai(H$n) = \H<S>k and A 2 {H<5> 7T ) = /!#$„ if and only if D(H) = \H and E(H) = 
fiH^ where 

A = — A and Jl = c + A + u. 

4 

To compute the constant c we take a highest weight vector v G V n , and write 
li, Y 2> I3 in terms of the basis {e, /, g} introduced in ©. It follows that 

i(A K )v = n (-(^(e + /)) 2 - (^(e - /)) 2 - (§/>) 2 ) « 

= — ir (-2e/ - 2/e - fr 2 ) v = -tt (2(/e + /i) + 2/e + /i 2 ) v 

4 v 1 4 

Thus c = £(£ + 2)/4 completing the proof of the proposition. □ 

3.1. Reduction to G/K. 

The quotient G/K is the sphere S 3 , moreover the canonical diffcomorphism is 
given by gK i-> (514,324,534,344) € S 3 . 

The function H associated to the spherical function $ is right invariant under K, 
then it may be considered as a function on S 3 , that we also called H. The differential 
operators D and E introduced in (|HJ| and ((9|), define differential operators on S 3 . 

Lemma 3.2. The differential operators D and E on G, define differential operators 
D and E acting on C°°(S 3 ) ® End(V^). 

Proof. The only thing we need to prove is that D and E preserve the subspace 

C°°(G)* (g)End(K)- 

First we prove that D commutes with I4. Since [14,14] = — 15, [14,15] = I4 
and [I4, ly =0 we have 



\D: 


= Y 1 Y 2 +Y 1 Y 5 2 + Y 1 Y 2 = 


-Y 5 Y 4 + Y 4 Y ± Y 4 + Y 4 Y 5 + Y 5 Y t Y 5 + Y X Y 2 




= -Y 5 Yi - Y 4 Y 5 + Y 4 2 Y X + Y±Y 5 + Y 5 Y 4 + Y 5 2 Y X + Y*Y X 




= Y 4 2 Y X + Y 5 2 Y X + y 6 2 !i = 


= DY 1 . 



Similarly we get that Y2D = DY2, therefore D commutes with every X £ 6, then 
D preserves C°°(G) (g> End(V^), since K is connected. 

Let us check that E has the the same property. For that it is enough to verify 
that for anylef and all H e C°°{G) K <g> End(K) we have X(EH) = 0. Now we 
use that $ 7I -tt(X) = X($ w ) for any let and we get that X(EH) — is equivalent 
to 

- XY a (H)$ k tt(Y 3 ) - Y A (H)$ K -k(X)-k(Y 3 ) + Y 4 {H)^tt{Y 3 )tt{X) 
+ XY 5 (H)$ w 7r(Y 2 ) + Y 5 (H)$ w -k{X)ir(Y 2 ) - Y 5 (H)^7r(Y 2 )ir(X) 

- XY 6 (H)*„*(Yi) - Y 6 (H)^-k(X)-k(Y 1 ) + y 6 (J?)$ 7r ^(F 1 )7r(X) = 0. 

Again we take X = li, having then 

- {r 1 ,Y4](B)$„*(Y a )-Yi(ff)$«<k(\yi,Y 3 ]) 

+ [Y 1 ,Y 5 }(H)^-k(Y 2 ) + Y 5 (H)^Tr([Y 1 ,Y 2 }) = 0, 
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since XH = for any X £ t. But that is equivalent to 

Y 5 (H)$ w ir(Y 3 ) - Y A {H)^-k{Y 2 ) + Y A {H)^-k{Y 2 ) - Y 5 (H)$ n ir(Y 3 ) = 0, 

which is true. Similarly we obtain that Y2{EH) = and therefore we reached the 
result, since {Yi, Y2} generates t. □ 

Now we give the expressions of the operators D and E in the coordinate system 
p : (S 3 ) + — > R 3 given by 

1 \ ( Xi X2 X A i \ 

p( x ) =—'—>—= (2/1,2/2,2/3 ■ 

\ X4 X4 X4 J 

The proofs of the following propositions require simple but lengthly computations 
and we don't include them in this paper, they can be found in [Z] . 

Proposition 3.3. For any H G C°°(R 3 ) (g) End(K-) we have 
D(H)(y) = (1 + ||y|| 2 )((y? + l)H yryi + {y\ + \)H mm + {y\ + l)H y3V3 

+ 2( yi y 2 H yiy2 + y 2 y 3 H y2V3 + yiy 3 H yiy3 ) + 2(y 1 H Vl + y 2 H y2 + y 3 H V3 ) 

Proposition 3.4. For any H <E C°°(R 3 ) ® End(K-) we have 

/ -y2-yiy3 -V3+V1V2 ' 
E(H)(y) = H yi n V2+yiy 3 -l-yl 

\y3-y1y2 l+t/i 

/ -y2ys+yi l+yl \ / -i-yl J/1+J/2J/3 

+ Fj, 2 7T I 1/2J/3-OT -V3-V1V2 I +if M 7T i +y | y 2 -yiy s 

V -1-2/2 ya+yiV2 / \-y1-y2y3 -y2+yiys 

3.2. Reduction to one variable. 

We are interested in considering the differential operators D and -E given in 
Propositions E31 and [331 applied to functions H € C°°(R 3 ) (g> End(K-) such that 

H(ky) = ir(k)H(y)ir(k)-\ for all k e K, y e R 3 . 

By taking into account the if-orbit structure of R 3 , this property of H allows us 
to find ordinary differential operators D and E defined on the interval (0, 00) such 
that 

{DH)(r, 0,0) = (DH)(r), (EH)(r,0,0) = (EH)(r), 

where H(r) = H (r, 0,0). Recall that the interval [0,oo) parameterizes the set of 
If -orbits in R 3 . 

In order to give the explicit expressions of the differential operators D and E, 
and starting from Propositions l3.3l and l3.41 we need to compute a number of second 
order partial derivatives of the function H : R 3 — > End(K-) at the points (r, 0, 0), 
with r > 0. Given y = (2/1,2/2, 2/3) G R 3 in a neighborhood of (r, 0, 0), r > 0, we need 
a smooth function onto K — SO (3) such that carries the point y to the meridian 
{(r, 0, 0) : r > 0}. A good choice is the following function 



(10) A(y) 




-2/2 



l|y||+yi 

-j/2^3 




Then 

y = A(y)(\\y\\ ,0,0Y 
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It is easy to verify that A{y) is a matrix in SO (3) and it is well defined in 
R 3 -{ (2/1,0,0) eR 3 :yi<0}. 

The proofs of the following propositions are similar to those in the case of the 
complex projective plane considered in [GPT2) . Let us consider the following ele- 
ments in I 

(11) A\ = E 2 i — E12, A 2 — £31 — -E13, A 3 = E32 — E 23 . 

Proposition 3.5. For r > we have 



8H. . dH , s 

f)TT 1 r ~ 

— (r,0,0)=- w{Ax),H{r) 

dy 2 r L 



f)M 1 r ~ 

— (r,0,0) = - Tr(A 2 ),H(r) 

dy 3 r L 



Proposition 3.6. For r > we have 

d 2 H , s d 2 H , . 



dyr 

dy2 
8 2 H, 



dr 2 

1 / dH 



(r, 0, 0) =- ( r— + n {Atf H{r) + H(r)n (Atf - 2n (Ai) H(r)n (A^ 



(r, 0, 0) =\ (r^- + n (A 2 f H(r) + H{r)-k (A 2 ) 2 - 2tt (A 2 ) H(r)n (A 2 ) 



dyz 2 r 2 \ dr 

Now we can obtain the explicit expressions of the differential operators D and E. 
Theorem 3.7. For r > we have 

d 2 H (l + r 2 ) 2 dH 



D(H)(r) = (l + rY-^T + 2 



dr 



(1 + r 2 ) /. 



(tt(A!) 2 H(r) + H(r)^(Ax) 2 - 27r(A 1 )H(r)7r(A 1 ) 
ii{A 2 ) 2 H(r) + H{r)Tr(A 2 ) 2 - 2ii{A 2 )H{r)ii{A 2 ) 



, (1 + r 2 ) 

Proof. Since D(H)(r) = D(H)(r, 0, 0), from Proposition 13 . 31 we have 

D{H)(r) = (1 + r 2 )((l + r 2 )H yiyi + H V2V2 + ff y3 , 3 + 2rff yi ) . 
Using Propositions 13.61 and 13.61 we get 



D(H)(r) =(1 + r 2 ) 



d 2 tf 



dff 



(1 + r)— -~-{r) + 2r— (r) + 



dr 2 



dr 



2dff 

dr 



+ \[n {A 1 f H(r) + H(r)n (A,) 2 - 2tt (Ai) ff(r)7r (Ai) 



+ -^(7r(^ 2 ) 2 J ff(r)+i?(r)7r(yl2) 2 - 2;', ( V 2 )JT(r)u (J.) 



Now the theorem follows easily. 



D 
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Theorem 3.8. For r > 



E (H)(r) = ^(l+r 2 )7r(A 3 )-- ir(A 1 1. //(/) /, i,-l,+ 1,) 
dr r 



+ - Tr(A 2 ),H(r) i:(A 1 -rA 2 ). 
r L J 

Proof. Since E(H)(r) = E(H)(r, 0,0), from Proposition 13.41 we have 



Now, from Proposition 13. 51 we get 



r 1 



-1 r 



£(#)(r) 



(ill . n. . . . 1 

= — (l + r 2 K(A 3 )-- 
ar r 



+ 



1 



7r(i4i),ff(r) tt(Mi+A 2 ) 
7r(^ 2 ),i?(r) 7r(i4i-rA 2 ), 



which is the statement of the theorem. 



□ 



Theorems 13.71 and 13.81 are given in terms of linear transformations. Now we will 
give the corresponding statements in terms of matrices by choosing an appropriate 
basis of V n . We take the s[(2)-triple {e, /, h} in be — sl(2, C) introduced in $j$. 
If 7T = %i is the only irreducible representation of SO(3) with highest weight £/2, 
we recalled in Subsection 12.41 that there exists a basis B — {vj} l , Q of V„ such that 

*(h)v j = (e-2j)v j , 
(12) n(e)v j = {£-j + l)v j -i, (w_i = 0), 

n(f)vj = (j + l)v j+ i, (v e+1 = 0). 

Proposition 3.9. The function H associated to an irreducible spherical function 
$ of type 7r £ K diagonalizes simultaneously in the basis B = {vj} ^ =0 of V n . 

Proof. Let us consider the subgroup M = { mg : 9 £ R } of K, where 

/l 

me = I cos 9 sin# 
\0 — sin 9 cos 9j 

Then M is isomorphic to SO(2) and it fixes the points (r, 0, 0) in R 3 . Also, since 
the function H satisfies H(kg) — ir(k)H(g) 7r(fc _1 ) for all k £ K, we have that 

H(r) = H(r, 0, 0) = H(m e (r, 0, 0)*) = Tr{m e )H(r, 0, O^m" 1 ) 
= TT(mg)H(r)ir(m B 1 ). 

Hence, H(r) and Tr(mg) commute for every r in K and every mg in M. 

On the other hand, notice that mg = exp(9^h) and then ir(mg) = exp(-k(9^h)), 
but from (|12p we know that 7r(/i) diagonalizes and that its eigenvalues have mul- 
tiplicity one. Therefore the function H(r) diagonalizes simultaneously in the basis 
S = {«,}* of K. 



D 
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Now we introduce the coordinate functions hj (r) by means of 

(13) H(r)vj=hj(r)vj, 
and we identify H with the column vector 

(14) H{r) = (h Q {r),...Mr)) t - 

Corollary 3.10. The functions H(r), (0 < r < oo), satisfy (DH)(r) = XH(r) if 
and only if 

( i + r 2)2£» + 2^^-h'i + ^u + w - m j+ i 1^) 

+ ±£-3(1 - j + l)(^_i - hj) = Xhj, 

for all j = 0, . . . , £. 

Proof. Using the basis B = {vj}j =0 of V n (see (fT2|) ) and writing the matrices Ai 
and ^2 in terms of the sl(2)-triple {e, /, /i}, see d3j) , 

A x = E 21 - E 12 = l -(e + f) , A 2 = E 31 - E 13 = l(e - /), 

we have that Theorem 13 . 71 says that (DH)(r) = XH(r) if and only if 



\H(r) Vj = (1 + r 2 ) 2 H"{r) Vj + 2 



{l + r 2 ) 2 ~, 



H'(r)vj 



(1 + r 2 ) 



4 r 2 
(1 + r 2 ) /. 



7r(e + /) 2 if (r) + H(r)jr(e + f) 2 - 2it(e. + f)H(r)<k{e + f) v 



4 r 2 



7r(e - /T # (r) + i?(r)7r(e - /) 2 - 27i(e - f)H(r)ir(e - f) Vj 



for < j < L 

As [e, f] — h we have that this equivalent to 

XH{r) Vj = (1 + r 2 ) 2 H"{r) Vj + 2 (1 + r ) ff'(r) ty 



(1 + r 2 
2r 2 



(tt(/i) + 27r(/)7r(e) )#(r) Wj + H(r)(ir(h) + 2Tr(f)w(e)) Vj 



2(7r(e)J3 r (r)7r(/) + 7r(/)Jf(r)7r(c)) ^ 



for 0<j<£. Now, using (fT2"j). we obtain that (DH)(r) = XH(r) if and only if 
Afy(r) Wj = (1 + r 2 ) 2 ^'(r) ^ + 2 (1 + ^- %(r) ^ 



(1 + r 2 ) 
2r 2 



((£ - 2j) + 2j(i - j + 1) Mr) vj + ft,-(r)((i - 2j) + 2j{£ - j + 1)) v s 
- 2((£-j)h j+1 (r)(j + l)+jhj-i(r)(£-j + 1))^ 



for < j < £. 

It can be easily checked that this is the required result. 



□ 
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Corollary 3.11. The functions H(r), (0 < r < oo), satisfy (EH)(r) = (J,H(r) if 
and only if 



- i(£ - 2j)^-hr + £ [{j + 1)(£- j)(h j+x - hi) - HI - j + l)(fy_i - hi) 
+ | ((J + m - 3)(hj+i - h) + M - J + l)(^-i ~ hi)) = yh h 



for all j = 0, ... , £. 

Proof. We proceed similarly to the proof of Corollary 13.101 Using the s[(2)-triple 
{e, /, h} and the matrices A\, A 2 and A3 (see ([H])), from Theorem 13.81 we have 
that (EH)(r) = ^H(r){r) if and only if 



nH{r) Vj =(1 + r 2 )H'{r)it (A 3 ) v 3 - - [tt (A x ) , ff(r)J tt {rA x + A 2 ) v 3 



ir(A 2 ),H(r) tt {A x - rA 2 ) Vj, 



for every Vj in B = {vj} 



3lj=0- 



As in the proof of the Theorem l3.10l we write A-\ . A? and A? in terms of {e. /, h} 
(see ©), 

Ai = |(e + /), A 2 = i(e-/), A 3 = -^h. 

Hence, (DH)(r) = XH(r) if and only if 



txH{r)vi =— [tt (e + /) , ff(r)J tt (r(e + /) - i(e - /)) Vj 



4.,. 



tt (e - /) , H(rj\ n (i(e + /) - r(e - /)) u, - jl±!ljT'(r)7r (ft) « is 



for < j < £. And that is equivalent to 



.1 + r 



pH(r)v j =-i—z-H'(r)ic(h)v j + -(r + i) ir(e),H(r) *(/) 



2r 



1 



+ ^( r_ «) ^ (/) > #( r )J K"( e )«ii 



for 0<j<£. 

Finally, we use (IT21 to obtain 



M^i Wj 



1 + r 2 



ti 3 {2£ - j) Vj + ^(r + i)(£ - j)(h j+1 - hj)(j + 1) Vj 



+ Yr^ ~ i)j ^- x ~ h ^ £ -3+ 1 ) V J> 



for < j < £. Therefore the corollary is proved. 



□ 



In matrix notation, the differential operators D and E are given by 



DH=(l + r 2 fH" + 2^± r2)2 ^ ' (1 '''' 



■H' 



(d + C )H, 
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EH = -i^S-AoH' + i(Ci - C )H + Uc x + C )H. 
2 2r 2 

where the matrices are given by 

(15) Co = E -=i W - J + l)(^w-i - E jtj ), 
Cx = E,t (j + m - 3)(E id+1 - E hJ ). 

We introduce the change of variables u — , 2 , u € (0, 1], and we put 

(16) H(u) = H (4=^) and h 3 (u) = h 3 (^EZ) . 

Under this change of variables, the differential operators D and E are converted 
into two new differential operators D and E. We get the following expressions for 
them, 

j2 tt jtt i 

(17) DH =(l-u 2 )- T -3u— + - M + d)H, 

au du 1 — u 

(18) EH = \W^A^ + \-j^{Ci - C )H + '-(Co + C l} H. 

Remark 3.12. At this point there is a slight abuse of notation, since D and E were 
used earlier to denote operators on M 3 . 

4. ElGENFUNCTIONS OF D 

We are interested in determining the functions H : (0, 1) — > C e+1 that are 
eigenfunctions of the differential operator 

^d 2 H dH 1 , 

DH = (l-u^-3u^ + — 2 (C + C 1 )H, 

«e (0,1). 

It is well known that such eigenfunctions are analytic functions on the interval 
(0, 1) and that the dimension of the corresponding eigenspace is 2(1 + 1). 

The equation DH — \H is a coupled system of t + 1 second order differential 
equations in the components (ho, ... ,hi) of H, because the (£ + 1) X (£+ 1) matrix 
Co + C\ is not a diagonal matrix. But fortunately the matrix Co + C\ is a symmetric 
one, thus diagonalizable. Now we quote the following result from |GPT3j . 

Proposition 4.1. The matrix Co + Cl is diagonalizable. Moreover the eigenvalues 
are —k(k + 1) for < k < £ and the corresponding eigenvectors are given by 
Uk = (U ,k,---,Ue t k) where 

(19) U j , k = 3 F 2 ( K ~ k '-tt +1 ;i 

an instance of the Hahn orthogonal polynomials. 
We will need the following technical lemma. 
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Lemma 4.2. Let U = {Uj.k) be the matrix defined by 

(20) ^ = 3F 2 (-\7^ +1 ;l), 

and let Aq, Cq and C\ be the matrices introduced in (|15l) . 
Then 

U- 1 A Q U = Q Q + Q 1 , 

(21) U- 1 (C 1 +C Q )U = -Vo, 

U- x {Ci - C )U = Qi J - Qo(J + 1), 

where 

t-i e 

v Q =j2j(j+m,j> J r =E^«. 

J'=0 j=0 

«-l £ 

y° ~ 2.^ 2j+3 fc JJ + l ' Wl - / , 2 j-l fc JJ-l ' 

J'=0 .7=1 

Proof. Firstly we observe that U~ 1 (Cx + Co) 17 = — Vq is a direct consequence of 
Proposition 14. II To prove that U~ 1 AoU = Qo + Qi is equivalent to verify that 

AoU = U(Q + Qi). 

By taking a look at the entry (J, k) for j,k — 0, ...,£, we obtain that 

If 9 Mr tj Hi + k + l) TT (k + l)(£-k) 
(i - 2j)Um = U,^ 2fc + i + EW 2fc + 1 ■ 

From [AARj (see page 346, equation (c)) we have that the last equality is satisfied 
by the Hahn polynomials. 
Now we prove that 

(22) U- 1 {C 1 -C )U = -Q (J + 1) + Q 1 J. 

By using that (C +C\)XJ = —UVq, (see (|2"Tjn we have that (|2"2")l is equivalent to 

-2C i7 = U(-Q (J + 1) + Qi J + V ). 

To prove this identity, as we did before, we consider the entry (j, k), then we need 
to prove 

~ 2 ( C o)j t jUj :k - 2(Co) ;M _ 1 £/j-i,fc = 

-Uj,k-i{Qo) k _ lk {J + l)k,k + Uj,k+i{Qi) k+ x jk Jk,k + Uj.k{V ) kk , 
or equivalently we have to verify that 

2j(£ - j + l)U jik - 2j(£ - j + l)Uj- llk = 

( 23 ) rr k(e + k + i) n ,, TT (k + i){e-k) t ,., 

~ j ' k ~ 1 2fc + l ( + } + J ' fe+1 2fcTl + ( + } j ' k - 

We use the same relation for the Hahn polynomials as before (see | A AR| . page 
346, equation (c)) 

(21 - j){2k + l)J7 ilfc -k(£ + k + l)Uj. k -i = (k + !){{, - k)Uj, k+ i, 
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therefore (|23|) becomes 

(2j(t -j + i + k)-k(k + i + e))Uj, k - 2j(e - 3 + 1)^-1^ = 

-fc(^ + fc + l)Z7 ijfc _i, 

which is satisfied by the Hahn polynomials, see |KMcGj . D 

If we define H(u) = U~ 1 H(u), we get that DH = XH is equivalent to 
^d 2 H dH 1 - 

where F = Ei^i(i + l)^,r 

In this way we obtain that DH = XH if and only if the j-th component hj (u) 
of H(u), for < j < I, satisfies 

(24) (1 - u 2 ) h'!(u) -iuh' 3 (u) - j(j + 1)_J_^.(„) - Xhj( U ) = 0. 

If we write A = — n(n + 2) with neC, and %(«) = (1 — u 2 y/ 2 pj{u). Then, for 
< j < £, pj (u) satisfies 

(25) (1 - u 2 )p'<(u) - (2j + 3) up'^u) + (n- j)(n + j + 2) Pj (u) = 0. 

Making a new change of variable, s = (1 — u)/2, s G [0, 5), and defining j5j(s) = 
Pj(u) we have 

(26) s(l - s)i^(s) + (j + I - (2j + 3) s)p'j(8) + (n - j)(n + j + 2)pj = 0, 
for < j < £. This is a hypergeometric equation of parameters 

a = —n + j , 6 = n + j ' + 2 , c = j + |. 
Hence every solution j5j(s) of |26|) for < s < \ is a linear combination of 

p /-n+j,n+j+2 \ , „-i-l/2 p / -n-l/2,n+3/2 \ 

2^1^ j+3/2 ,sj and s 2^1 (^ -i+1/2 ' S J- 

Therefore, for < j < £, any solution hj(u) of (f2~4")l . for < u < 1, is of the form 

h („,\—„ (\ o, 2 V/ 2 T? ( -n+j,n+j+2 , l- u \ 

hj{u) =a,j{± -u y 2^1 ( j+3 /2 ;-2-J 

(27) 

+ 6, (1 - u 2 )-°' +1)/ Vi ( —^;+ 3/2 ; V) . 

for some o^, 6^ G C 

Therefore we have proved the following theorem. 

Theorem 4.3. Let H{u) be an eigenfunction of D with eigenvalue X = —n(n + 2), 
neC. Then H is of the form 

H{u) = UT{u)P{u) + US(u)Q(u) 

where U is the matrix defined in (|20p . 

T{u) = J2(l u 2 y/ 2 E 3J , S(u) = £(1 - u 2 )-^/ 2 E n , 

3=0 3=0 
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P = (po, . . . ,peY and Q = (qo, . . . , qi) 1 are the vector valued functions given by 

■n (n,\ — n P ( -™+^™+J+ 2 . l-u \ 

p 3 {u) - a 3 2 t<\ y i+ 3/2 i -5- J , 

n („\ - h W ( -™-l/2,"+3/2 . l_ u \ 

where a,j and bj are arbitrary complex numbers for j = 0, 1, . . . ,£. 



Going back to our problem of determining all irreducible spherical functions $, 
we recall that $(e) = /, then the associated function H £ C°° (K 3 )(8)End(V 7r ) satisfy 
-ff (0, 0, 0) = /. In the variable r £ R we have that lim r ^ + H(r) = I. Therefore we 
are interested in those eigenfunctions of D such that 

lim H{u) = (l,l,...,l)eC £+1 . 

u— >1 

From Theorem 14.31 we observe that 

lim P(u) = (a ,ai,. . . ,ae) and lim Q(u) = (b ,bi, . . . ,be). 

U—}1 u— > 1 

Moreover the matrix T(u) has limit when u — > 1 _ , while S(u) has not. Therefore 
an eigenfunction H of D has limit when u — > 1~ if and only if the limit of Q(u) 
when u — > 1~ is (0, . . . , 0). In such a case we have that 

lim H{u)= lim UT{u)P{u) = U (o , 0, . . . , 0)' = a (l, • . . , l) f . 
In this way we have proved the following result. 

Corollary 4.4. Let H(u) be an eigenfunction of D with eigenvalue X = —71(71 + 2), 
n £ C, such that lim.^^j- H(u) exists. Then H is of the form 

H(u) = UT{u)P{u) 
with U the matrix defined in (|20| . T{u) — y (1 — u ) 3 ' Ejj, and P — (p , . . . ,pi) 1 

3=0 

is the vector valued function given by 

m (n,\ — n 7? ( ~ n +J: n +3'+ 2 . 1-lt A 

Pj{u) -a 2^1 y J+3/2 >— J 

where dj are arbitrary complex numbers for j = 1,2, ...,£. Also we have that 
lirOy,^!- H(u) = o,q(1, 1, . . . , 1)*, then if H(u) is associated to an irreducible spher- 
ical function we have a Q = 1 . 

5. Eigenfunctions of D and E 

In this section we shall study the simultaneous solutions of DH(u) = \H(u) and 
EH{u) =/j,H(u), 0<u< 1. 

We introduce a matrix function P(u), defined from H(u) by 

(28) H{u) = UT{u)P{u) 

where U is the matrix defined in flUD and T(u) = X^ol 1 - u ' 2 V /2E jj- 

The fact that H is an eigenfunction of the differential operators D and E, makes 
P an eigenfunction of the differential operators 

D = {UT{u)Y 1 D{UT{u)) and E = (C/T(m)) _1 E (UT(u)) , 

with, respectively, the same eigenvalues A and fi. The explicit expressions of D and 
E are given in the following theorem. 
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Theorem 5.1. The operators D and E defined above, are given by 
DP = (1 - u 2 )P" - uCP' - VP, 
EP=± ((1 - u 2 )Q + Q x ) P' - \uMP - \V Q P, 

where 

l £ 

C = £(2j + i)E n , V = J2M + 2 ^ ' 

3=0 j=0 

£-1 £ 

(2yj Wo - 2^ — 2j+3 — %j+i' Wi - 2^ 2j-i %j-i' 

i=o i=i 

f-i £-i 

Proof. Let H = 2f(«) = UT(u)P(u). We start by computing D(.ff) for the differ- 
ential operator D introduced in (|17[). 

DH = (1- u 2 )UTP" + (2(1 - M 2 )t/T' - 3uUT)P' 

+ ((1 - u 2 )[/T" - 3wPT' + ^(Co + Ci)UT)P 

= UT((1 - u 2 )P" + (2(1 - u 2 )T~ l T' - 3u)P' 

(1 - u 2 )T- x T" - 3uT~ l T' + — —tT- 1 U- x (Cq + d)UT)P 

1 — u 2 ) 

Since T is a diagonal matrix we easily compute 

I i 

T-\u)T'(u) = -^^j E n , T- l T"(u) = II= ^ F J2 M' " ^ ~ !) ^ ■ 

Also from ([21]) we have that £/ _1 (Co + C\)U — —Vq- Since Vq is a diagonal matrix 
it commutes with T and we get 

(1 - u^T^T" - 3uT _1 T' + ^T^CT^Co + Ci)UT 

1 — u 2 

1 - 

1 W ' .7=0 

Now for the differential operator E introduced in (fT5|) we compute E(H) with 
iJ( M ) = UT{u)P(u). 



EH = — v/l -u 2 A UTP' 



l -Vl-u 2 A ur + I JL-p iCi - C )UT+±(C + C X )UT\P 



= UT( -Vl-u 2 T- 1 U- l A UTP'+ I -y/l -u 2 T- 1 U- 1 A UT' 
+ L—JL^T-i-U-^a - C )UT + ^T- 1 U-\C + d)UT\P 
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From Lemma 14.21 above we have that U 1 AqU = Qo + Qi- By using that 

T = EU°( 1 - u2 Y /2E n we & et 



y/l-u 2 T- 1 U- 1 A Q UT = y/l-u^T^iQo + Qi)T = (1 - u 2 )Q Q + Q t . 

From dHJ and the fact that T is diagonal we have that T~ 1 U~ 1 (C +Ci)UT = -V - 
Then it only remains to prove that 

(30) y/l -u 2 T- 1 U- 1 A UT' + - U T-^-^Ci - C )UT = -uM. 

V 1 — u 2 

Since T'(u) = ^^ JT(u), where J = ^2,j—qJEjj, we have to prove that 



(31) T-^U^AoUJ - U~\Cx - C )U)T = y/\ - u 2 M. 

From Lemma 14.21 we have 

U- l A UJ - U-\Ci - C )U = (Qi + Qo) J - QiJ + Qo(J + 1) = Qo(2 J + 1) 

t-i 

3=0 

Since T — 52,-_ (l ~ u 2 )^ 2 Ejj, (|31|) is satisfied and this completes the proof of the 
theorem. □ 

The function P is an eigenfunction of the differential operator D if and only 
if the function H = UT(u)P(u) is an eigenfunction of the differential operator 
D. From Theorem 14.31 we have the explicit expression of the function P(u) = 

(p (u),...,p e (u)Y, 

<n (,A — n TP f~n+j,n+j+2, i_ u \ , ,-, 2\-(j+l/2) p / -n-l/2,n+3/2 . i_„\ 

Pj(u) - Qj 2^1 ^ i+3/2 , -2~ J + Oj U - « J '2^1 ^ -j+1/2 ' ^~; ' 

where Oj and &j are in C, for < j < £. 

Since we are interested in determining the irreducible spherical functions of the 
pair (G,K), we need to study the simultaneous eigenfunctions of D and E such 
that there exists a finite limit of the function H when u — > 1~ . 

From Theorem 14.31 we have that lim u ^i- H(u) is finite if and only if 

lira b 3 (1 - u 2 )-^ 1 '/ Vi ( - n -}'l^ 2 m ; V) . f™ ^11 < j < t, 

exists and it is finite. This is true if and only if bj — for all < j < £. Therefore 
lim u ^ > . 1 - H(u) is finite if and only if lim^^- P(u) is finite. 

From Corollary |4.4l we know that an eigenfunction P = P{u) of D in the interval 
(0, 1) has a finite limit as u — > 1 _ if and only if P is analytic at u = 1. Let us now 
consider the following vector space of functions into C i+1 , 

W\ = { P = P(u) analytic in (0, 1] : DP = XP } . 

A function P £ W\ is characterized by P(l) = (<Xq, ■ ■ ■ ,ai). Thus the dimension 
of W\ is I + 1 and the isomorphism W\ ~ C e+1 is given by 

^:J¥ A — >C i+1 , PH-P(l). 

The differential operators I? and £" commute because they are closely related to 
the Casimir operators Ai and A2 which are in the center of the universal enveloping 
algebra D(G) G . Then the differential operators D and E commute. 
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Proposition 5.2. The linear space W\ is stable under the differential operator E 
and it restricts to a linear map on W\. Moreover the following is a commutative 
diagram 

E 



(32) 



W x 

"I 

c e+i 



W x 



L(\) 



c e+i 



where L(X) is the (£ + 1) x (£ + 1) matrix 

L(X) = -%Q X C- X {V + A) - |M - iy 

-j+i)((j-i)0'+i)+a) 






2(2j-l)(2j+l) 



-E* 



{ / , 2 -^J.J + 1 

3=0 



E 

J=0 



j(j+1) 



£ 



33- 



Proof. The differential operator E takes analytic functions into analytic functions, 
because its coefficients are polynomials, see Theorem 15. 11 A function P £ W\ is 
analytic, then lim u _j.i- EP(u) is finite. On the other hand since D and E commute, 
the differential operator E preserves the eigenspaces of D. This proves that W\ 
is stable under E. In particular E restricts to a linear map L(X) on W\, to be 
determined now. 

From Theorem 15. II we have 

v{E{P)) = (EP)(l) = iQrP'Cl) - §MP(1) - lV P(l). 

But we can obtain P'(l) in terms of P(l). In fact, if we evaluate DP = XP at 
u = 1 then we get 

P'(1) = -C*" 1 (F + A)P(1). 
Notice that C is an invertible matrix. Hence 

v{E{P)) = -^ 2 QiC~ l (V + A)P(l) - |MP(1) - iy P(l) 
= L{X)P{l) = L{X)v{P). 
This completes the proof of the proposition. □ 

Remark 5.3. If A = —n(n + 2), with b£C then we have 



L(X) 



_ -ST 3(.e-j+l)(n-j + l)(n+j + l) 



(33) 



j'=i 



2(2j-l)(2j + l) 






(j+i)(i+j+2) 



£ 



M+l 



j(j+l) 



/ j 2 "-"J'i- 

J=0 



Corollary 5.4. ^4ZZ eigenvalues fi of L(X) have geometric multiplicity one, that is all 
eigenspaces are one dimensional. 

Proof. A vector a — (ao, a±, . . . , a^ ) is an eigenvector of L(X) of eigenvalue fj,, if and 
only if {a?} • n satisfies the following three term recursion relation for j = 0, . . . ,£, 



(34) 



2(2j-l)(2j+l) 



a.j-i 



T-j + l — M Oj" 
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where we interpret a_i = ai+i = 0. From these equations we see that the vector a 
is determined by ao, which proves that the geometric multiplicity of the eigenvalue 
/i of L(X) is one. □ 

Finally we get the main result of this section which is the characterization of 
the simultaneous eigenfunctions H of the differential operators D and E in (0, 1), 
which are continuous in (0, 1]. Recall that the irreducible spherical functions of the 
pair (G, K) give raise to such functions H . 

Corollary 5.5. Let H(u) be a simultaneous eigenfunction of D and E in (0, 1), 
continuous in (0,1], with respective eigenvalues X = —n(n + 2), n £ C, and \i. 
Thus H is of the form 

H{u) = UT{u)P{u) 
i 
with U the matrix given in (|20|) . T(u) — V"j(l — u ) 3 ' Ejj, and P = [p 0l . . . ,pif 

j=0 
is the vector valued function given by 



+J+2 . i_, 
2 I 2 



t \ r? ( —n+j,n-\ 

PjW = ajiFi[ j+a/ 

where {a,j}, =0 satisfies the recursion relation (|34[) . 

Also we have that H(l) = ao(l, 1, ■ • ■ , 1)', then if H(u) is associated to an irre- 
ducible spherical function we have that ao = 1. 

In S 3 , the set 

{xg = {Vl-0 2 ,0,0,9):6e [-1,1]} 

parameterizes all the i^-orbits. Notice that for 9 > we have that xg g (S 13 )" 1 ", 
and p(xe) — ( \ g2 ,0, 0). Therefore, in terms of the variable r £ [0, oo) we have 



that r = ^ 1 e e , and then in terms of the variable u £ (0, 1] we get u = ,}o = 9. 

Hence, given an irreducible spherical function $ of type 7r £ K, if we consider the 
associated function H : S* 3 — > End(Vn-) defined by 

ff( 5 (0,0,0,l) t ) = $( ff )$- 1 (5), geG, 

we have that 



(35) iJ(Vl-u 2 , 0, 0, u) = diag{H(u)} = diag{UT(u)P(u)}, 

where H(u), u £ (0,1], is the vector valued function given in Corollary 15.51 and 
diag{H(u)} means the diagonal matrix valued function whose fcfc-entry is equal to 
the fc-th entry of the vector valued function H(u). 



6. Eigenvalues of the spherical functions 

The aim of this section is to use the representation theory of G to compute the 
eigenvalues of an irreducible spherical function $ corresponding to the differential 
operators Ai and A2. From these eigenvalues we shall obtain the eigenvalues of 
the function H as eigenfunctions of D and E. 
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As we describe in Section [2] there exists a one to one correspondence between 
irreducible spherical functions of (G, K) of type <5 £ K and finite dimensional irre- 
ducible representations of G which contain the X-type 8. In fact every irreducible 
spherical function $ of type 5 £ K is of the form 

(36) $(g)v = P(S)r{g)v, g £ G, v £ P(S)V T , 

where (r, V T ) is a finite dimensional irreducible representation of G which contains 
the -ftT-type 5 and P(S) is the projection of V T onto the -ftT-isotypic component of 
type 6. 

The irreducible finite dimensional representations r of G — SO (4) are parame- 
terized by a pair of integers (mi, 1712) such that 

mi > |m 2 |, 

while the irreducible finite dimensional representations %i of K — SO (3) are pa- 
rameterized by £ £ 2Z>0. 

The representations T( mim2 ) restricted to SO(3), contains the representation wg 
if and only if 

mi > § > |m 2 |. 

Therefore the equivalence classes of irreducible spherical functions of (G, K) of type 
■Ki are parameterized by the set of all pairs (7711,7712) £ Z 2 such that 

toi > I > \m 2 \. 

Theorem 6.1. Let $v™ 1 ' m2 ' ) & e t/ie spherical function of type ir?, associated to the 
representation Ti mim2 \ of G . Then 

i*£ = l( TO i _ m 2)(mi - m 2 + 2)<P^ 

2 $ e ' = j(m 1 + m2)(mi + m 2 + 2)®l 

Proof. We start by observing that the eigenvalue of any irreducible spherical func- 
tion $ corresponding to a differential operator A £ D(G) G , given by [A$](e), is a 
scalar multiple of the identity. Since Ai and A2 are in D(G) G we have that 

[Al fc(m um,) ]{e) = f(mi)m2)(Al ) and [A 2 $f - m2) ](e) = f (roi , m2) (A 2 ). 

These scalars can be computed by looking at the action of Ai and A 2 on a 
highest weight vector v of the representation T( mi ,m 2 )t which highest weight is of 
the form mi£i + m 2 e 2 . 

Recall that 

A x = (iZ 6 ) 2 + iZ 6 - {Z 5 + iZi)(Z 5 - iZ 4 ), 
A 2 = (^Z 3 ) 2 + iZ 3 - (Z a + iZ 1 ){Z 2 - iZ x ). 
Since (Z% — iZ±) and (Z 2 — iZ\) are positive roots vectors and Z§,Z-$ £ f)c, we get 
T( mu m 2 )(Ai)v = T (mum2) {iZ & ) 2 v+ f( mi)m2 )(«Z 6 )u = |(mi -TO 2 )(mi -m 2 + 2)v, 
T(mi,m2)( A 2> = T (mi , m2 ) (iZ 3 ) 2 'i; + f( mi)m2 )(«Z 3 )u = ±(mi + m 2 )(mi + m 2 + 2)u. 
This completes the proof of the theorem. □ 

Now we give the eigenvalues of the function H, associated to an irreducible 
spherical function, corresponding to the differential operators D and E. 
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Corollary 6.2. The function H associated to the spherical function $^ 1 ' satisfies 
DH = XH and EH = \iH with 

A = -(mi - m%)(m\ - m 2 + 2), 

(37) ^ + 2) , , , u 

/i = h (mi + ljm 2 . 

Proof. Let $ = $( mi > m2 ). From Proposition IO we have that Ai$ = A$ and 
A2 < & = fi& if and only if DH = XH and EH = ^H where the relation between the 
eigenvalues of H and <& is 

A=-4A, n = -l£(£ + 2) + Ji-X. 

Now the statement follows easily from Theorem 16. II □ 

Remark 6.3. Notice that we have just proved that the eigenvalue A of the operator 
D corresponding to a function H associated to an irreducible spherical function can 
be written in the form 

(38) A = -n(n + 2), with n e Z> . 

Proposition 6.4. If $ is an irreducible spherical function of (SO(4), SO(3)) then 
3>(-e) = ±1. Moreover, if $ = $( mi ' m2 > and g G SO (4) then 

= f$( 5 ) if m 1 +m 2 = mod (2) 

[ — $(<?) «/ mi + TO2 = 1 mod (2). 

Proof. As we mentioned in the Section [5J every irreducible spherical function of 
the pair (SO(4), SO(3)) of type ir, is of the form $( 3 ) = P„r(jg), where r G SO (4) 
contains the K-type ir and P„- is the projection onto the 7r-isotypic component of 

Let 77 be the highest weight of r = (mi, m-2) G SO(4), i.e. n = m\&\ + m-ie-i (see 
Subsection 12.41) . We have that 

/ TT 

-e - exD I -*■ ° ° ° 

C — LXp I 7T 
V -7T 

therefore if v is a highest weight vector in V T of weight 77, we have 

r(-e)v = e-*' mi+m2 ^ = ±«. 

Since t(— e) commutes with r(g) for all g G SO(4), by Schur's Lemma r(— e) is a 
multiple of the identity . Thus 

, , _ J /, if mi + ™2 = mod (2) 
[ —I, if nil + m-2 = 1 mod (2) 

Therefore 

$(-<?) = P„t(- 9 ) = P v T(-e)T{g) = r(-e)$( 3 ). 

Hence the proposition is proved. □ 
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7. From P to $ 

7.1. Correspondence between polynomials and spherical functions. 

In the previous sections we were interested in the irreducible spherical functions 
of a fixed if -type tt and we arrived to the study of the space of vector valued 
eigenfunctions P(u), analytic in (0, 1], of the differential operators D and E, 

DP = (1- u 2 )P" - uCP' - VP, 

EP=\ ((1 - u 2 )Q Q + Qi) P' - |uMP - \V P, 



see Theorem 1 5. II and Corollarv l5.5l 

In this subsection we show that, given m € if, there is a one to one correspon- 
dence between the vector valued polynomial eigenfunctions P(u) of D and E such 
that the first entry of the vector P(l) is equal to 1, and the irreducible spherical 
functions $ of type ir^. For that we first need the following lemma. 

Lemma 7.1. Given £ G 2Z> and n £ Z> , for < j < £, the functions 

p.j(u) - a 3 2 ti y j+3/2 ,~2T), 

where ao = 1 and {a,j}j =0 satisfies the recursion relation (|34p for some \i, are 
'polynomial functions. Furthermore, if j < n then a,j is zero or the degree of pj is 
equal to n — j, and if n < j then Qj — 0. Also, when n < £ we have that a n is not 
zero. 

Proof. Let us consider the vector valued function P(u) — (po{u), . . . ,pt(u)) . From 
Section [5] we know that P(u) is a simultaneous eigenfunction of the operators D 
and E of the Theorem 15.11 

For < j < n, the hypergeomctric function 

is a multiple of the Gegenbauer polynomial C^_ ■(«) (see [ASj . page 561). When 
n < j < £, we know that ((39]) is not a polynomial. But the expression of E in 
Theorem 1 5. 1[ which involves only three-diagonal matrices, tells us that for each j 
we have 

(40) m = | ((1 - " 2 ) 0+1 ^ +2 ^ + i + ^T^-i) 

- fu(j + 1){£ + j + 2)p j+l - ±j(j + l)p r 

Hence, if Pj and Pj-i are polynomials then 

P( U ) = 2j+S P'j+l( U ) ~ u P3 + li u )i < U < 1, 

is also a polynomial function in u. Let pj+\{u) = X)fc>o bkU k , therefore 
p{u) = Y,kb k ±j^u k -i~b k u k +\ 

If we denote 6_2 = b-i = we have 

p(«) = E wk bk + 2uk+l - 2m b " uk+l - b * uk+1 > 

k>-2 
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hence, for k + 1 bigger than the degree of p(u) 

fc + 2j + 3 

bk +i- bk k + 2 ' 

then |6fe+2| > |frfc| for /c + 1 sufficiently large. Therefore bj~ = for fc bigger than 
the degree of p(u). Thus p^+i is a polynomial. 

In other words, if Pj~ 2 and Pj-i are polynomials, then so is pj. Also recall that 
for j > n, (|39[) is an infinite series, but since Pj(u) = ajC^_Au) is a polynomial a,j 
is necessarily zero. 

If a n is zero we would have that every cij is zero, by (1341) . but that is absurd 
because oo = 1- Q 

Theorem 7.2. Given £ G 2Z>o. n G Z>o, every eigenfunction P(u) of D and E 
analytic in (0, 1], with eigenvalues A = —n(n + 2) and /i, respectively, corresponds 
up to a scalar to an irreducible spherical function $ of type it( G K . 

Proof. From Corollary 15. 51 we know that P(u) — (po(u), • ■ • >w(w))' is a simultane- 
ous eigenfunction of D and E, with eigenvalues A = — n(n + 2) and /i respectively, 
if and only if for every < j < t 

Pj[u) -a j2 ti^ j+3/2 ,— 

where {aj}^ =0 satisfies the recursion relation (|3"4")l . Recall that {ajYj = $ satisfies 
the recursion relation Q34p if and only if a = (ao, . . . , ai ) is an eigenvector of the 
matrix L\ with eigenvalue fi. From Corollary 15 .41 we know that every eigenspace of 
L\ is one dimensional, then up to scalars there are no more than £+1 eigenvectors. 
Therefore using Lemma 17. II we conclude that up to scalars there are no more than 
min(£ + 1, n + 1) eigenvectors of L\. In other words, given A = — n(n + 2) with 
n G Z>o, up to scalars there are no more than min(£ + l,n + 1) simultaneous 
eigenfunctions P(u) of D and E analytic in (0, 1], such that DP = \P. 

Hence it is enough to prove that for each A = — n(n + 2), n E Z>0, there are 
exactly min(^ + l,n+ 1) irreducible spherical functions of type tti £ K such that 
each one is associated to a different eigenfunction P{u) of the operators D and E 
with DP = XP. 

As we have said, the equivalence classes of irreducible spherical functions of 
(G, K) of type tti are parameterized by the set of all pairs (mi, m-i) G Z 2 such that 

mi > | > \m 2 \. 

To every irreducible spherical function $y™ 1,m2 -' corresponds a vector valued eigen- 
function pj; mi -' m2 > f th e operators D and E whose eigenvalues, according to Corol- 



lary [621 are respectively 

,(mi,m 2 ) / \/ . r,\ 

A^ = — (mi — TO2)(mi — m2 + 2), 

(m 1 ,m 2 ) £(l+2) . / . -, -, 

fj,\ = — y - 1 — L + (mi + l)m 2 . 

Easily we see that for different pairs (1111,1712), such that m\ > | > |m 2 |, one 
has different eigenvalues xf 11 '™ 12 ' an d /j^™ 1 '" 12 ' . Hence each irreducible spherical 
function tyy 11 '™ 2 ' [ s associated to a different eigenfunction pj; mi ' m2 \ 

If mi — m-2 = n, the function P) 1 ' m2 is an eigenfunction of the operators D and 
E with DPI™ 1 '" 12 ' = -n(n + 2)P { ™ 1 ' m2) . Since there are exactly min(£ + 1, n + 1) 
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pairs (011,1712) satisfying mi > I > |m2| and mi — 771,2 = n, we have proved the 
corollary. 

□ 

Recall from Corollary 15.51 that if P(u) — (po(u), . . . ,pi{u)) t is a simultaneous 
eigenfunction of D and E associated to an irreducible spherical function with 
P(l) = (ao, • ■ • , ai) 1 € C £+1 , then 00 = 1- Therefore we have the following corollary 
about the correspondence between irreducible spherical functions and eigenfunc- 
tions of D and E. 

Corollary 7.3. Given £ G 2Z>o, every eigenfunction P(u) of D and E analytic in 
(0, 1] with eigenvalues A = — n(n+2) ; 77 G Z> , and fj,, respectively, such that P(l) = 
(l,ttij ■ ■ • ,o,t)> corresponds to an irreducible spherical function <& of type n? G K. 
Conversely, every irreducible spherical function of type irg G K is associated to one 
of such functions P{u). 

If we take n = mi — 7772 and k = 7772 + £/2 in Corollary 16. 21 we have that for an 
eigenfunction P(u) of D and E, associated to an irreducible spherical function of 
type TTg G K , the respective eigenvalues are of the form 

A = -77(77 + 2), M = -i (~ + lj + (n + k - i + lj (k - I 

with < 77 and < k < min(77,, £). And now we can state the main theorem of this 
paper. 

Theorem 7.4. There exists a one to one correspondence between the irreducible 
spherical functions of type tt£ G K and the vector valued polynomial functions 
P(u) = (p (u), . . .,Pi(u)Y with 

t, (,,\ —n V ( -n+j,n+j+2 . \-u \ 

p 3 {u) - a,j 2 t\ y j+3/2 , -^-j , 
where n G Z>o, ao = 1 and {a,j}i = o satisfies the recursion relation 

A j(e-j+l)(n-j+l)(n+j+l) jQ + 1) A (j + l)(l+j+2) _ 

I 2(2j-l)(2j+l) J -1 2 U J l 2 "3 + 1 — P u 3' 

wit/i /i 0/ ifte /orm 

^ (t \ ( . t 



A * 2 V2 ' J ' V" 2 

for k G Z suc/i iftai < fc < min(n, £). 

7.2. Reconstruction of an irreducible spherical function. 

Fixed £ G 2Z>o we know that a function P = P(u) as in Theorem 17.41 is associ- 
ated to a unique irreducible spherical function $ of type irg G K. Now we show how 
to construct explicitly the function $ from such a P. Recall that P is a polynomial 
function. 

Let us define the vector function H{u) = UT(u)P(u) — (ho(u), . . . , he(u)), u G 
[— 1, 1], with U and T(u) as in Corollary [53] and let diag{H(u)} denote the diagonal 
matrix valued function whose fc/c-entry is equal to the &-th entry of the vector valued 
function H(u). 
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In the other hand, consider the function H : S 3 — > End^Tr) associated to 
the irreducible spherical function $, from Corollary 15.51 and (|35|) we know that for 

u e (o, l) 

H{Vl-u 2 , 0, 0, u) = H(u). 

Therefore, since both functions in the equality above are analytic in (—1,1) and 
are continuous in [—1,1], we have that 



H{^/l-u 2 , 0, 0, u) = H(u), 

for all u £ [-1,1]. 

Since H{kx) = wg(k)H (x)^ 1 (k) for every igS 3 and k £ K, we have found the 
explicit values of the function H on the sphere S 3 . Then we can define the function 
H:G—>Evd{V„ t )by 

H(g)=H(gK), g £ G. 

Finally, we have that the irreducible spherical function $ is of the form 

<%) = H(g)$ ne (g), geG, 
where fy^ is the auxiliary spherical function introduced in Subsection 12.61 

8. Hypergeometrization 

In this section for a fixed I £ 2Z> , we shall construct a sequence of matrix 
valued polynomials P w closely related to irreducible spherical functions of type 
■ki £ K. Then we will use the first matrix valued polynomial Pq in the sequence to 
consider the differential operators D = Po~ 1 DPq and E = Po~ 1 EPq. 

For a given nonnegative integer w let us consider the matrix P w whose fc-th 
column is given by the vector valued function P associated to the spherical function 
^(w+e/2 -k+l/2)^ for /. = o, 1, 2, . . . ,^ (see Theorem [O]). Therefore the fc-th column 
of P w is an eigenfunction of the operators D and E with eigenvalues 

\ w (k) = -(w + k)(w + k + 2) and fj, w (k) = io(| - k) - &(§ + 1), 
respectively. Then, we have 

(41) [P w (u)kk = aj' k 2 F, (—*+J^^- +2 ; (1 - u)/ 2 ) , 

where a^' = 1 for all k and {a"' }i =0 satisfies 

A j{t-j+l){w+k-j+l)(w+k+j+l) w.k _ j(j + l) w,k _ A (] + l)(i+j+2) w,k 
, 42 n l 2(2j-l)(2j+l) a j-l 2 tt 3 l 2 a 3 + l 

= (w(i-k)-k(i + i)) a y> k 

In the particular case that w = we have the following explicit formulas for a ■' . 
Proposition 8.1. We have 

(43) 3 {k-j)\{2j)\ - J ~ ~ 

a°' fe = for0<k<j <£. 
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Proof. We only need to check that these a^' satisfy the following three term re- 
cursive relation: 

(AA\ „- j(l-J + l)(fc-J + l)(fc+J+l) 0>fc 3(3 + 1) n 0,fc . (3 + l)(£+j+2) O.fc _ k(l+2) O.k 
\^> % 2(23-l)(23 + l) °J'-1 2 a 3 ~ % 2 a j+l ~ 2 Q j > 

,k _ 

k < t we have 



because a ' = 1. Notice that if the coefficients a ■' are given by (|43|) , for < j < 



■ O.fc _ 23-I O.fc ■ 0,k _ k-j 0,fc 

m j-l— k-j+i a j ' la j + l - 2j+i a j ■ 



Hence, for < j < k < £ (|44j) is equivalent to 

j(l-j+i)(fc+j+i) „o,fc _ 3(3+1) o,fc _ (j+i)(^+j+2)(fc-j) o,fc _ k(e+2) o.k 

2(23 + 1) "3 2 U j 2(23 + 1) U 3 2 U 3" ' 

which can be easily checked. 
If j = k + 1 we have 

„. (fc+l)(l-(fc+l) + l)(fc-(fc+l) + l)(fc+(fc+l) + l) o,k _ n 
' 2(2j-l)(2j+l) "fc ~~ U ' 

which is true. And if j > k + 2 we just have = 0. Therefore the coefficients given 
by (|43|) satisfy (|42|) and the proof is finished. D 

Now we introduce the matrix valued function $ defined by the first "package" 
of spherical functions P w with w > 0, i.e., 

(45) *(u) = P (u). 

Recall that ^(u) = (JS jk)jk is an upper triangular matrix polynomial with 

(46) (2j + l)(-2Q'-fc!j! +1 

(46) * jfe_ (jfc + i + l)! Cfc ^ (M) ' 

for < j < k < £, where C^_-(u) is the Gegenbauer polynomial 

(47) C£){u) = (* + * + X ) ^ ( -+^+ 2 ; (f - „)/2) . 

Since the fc-th column of ^ is an eigenfunction of D and E with eigenvalues 
A (fc) = — fc(fc + 2) and /xo(fc) = — fc(| + 1) respectively, the function \1/ satisfies 

(48) 5* = *A and E 1 * = $M 0) 

where A = Efc=o x o(k)E kk and M = ^ fc=0 Vo(k)E kk . 

Remark 8.2. Since the entries of the diagonal of $f(u) are nonzero constant poly- 
nomials we have that ^(u) is invertible. Even more, the inverse \1/ _1 (m) is also an 
upper triangular matrix polynomial. This can be easily checked, for instance, using 
the Crammer's rule, since the determinant of ty(u) is a nonzero constant. 

Theorem 8.3. Let D and E be the differential operators defined in Theorem \5.1l and 
let ^ the matrix valued function whose entries are given by (|46[) . Let D = '9~ 1 D^ 
and E = ^i~ l E^, then 

DF =(1 - u 2 )F" + {-uC + S X )F' + A Q F, 
EF ={uR 2 + R X )F' + M F, 
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for any C°° -function F on (0, 1) with values in <C i+1 , where 
i i 

C = £(2j + S)E jS , & = £ 2 ^ + Wm+i* 

3=0 J=0 

l-i e-i e 

j=0 j=0 3=0 

I I 

A o = Y, - k ( k + 2 ) E Jj> M ° = £ - fc (l + i )- B w- 

J=0 3=1 

Proof. By definition we have 

DF =(1 - u 2 )^" + * _1 [2(1 - w 2 )*' - uCf]F' 

+ $ _1 [(1 - u 2 )^>" - wC*' - V*] F, 

EF =^- l [{l - u 2 )Q + Qi]^F' 

+ *-! [§ ((1 - u 2 )Q + Qi) *' - §uAf* - ±V *] F. 

By using (|48p we observe that 

(1 - u 2 )*" - uC^' - Vm = L>* = *A , 

§((1 - u 2 )Q + Qx)* 7 - §uM# - il/ * = £* = #M . 
To complete the proof of this theorem, we use the following properties of the 
Gegenbauer polynomials (for the first three see [KSj page 40, and for the last one 
see 0). 

rlC x 

(49) -^(u) = 2XC^l(u), 

(50) 2(n + X)uC*(u) = (n+ l)C£ +1 (u) + (n + 2A - lJC^u), 

(51) (1 - " 2 )^f M + (1 - 2A)«C*(«) = - ( " + 1 2 ) ( ( f_ + 1) "" 1) C^ 1 1 ( U ), 

(52) ^27a^tt c "+ i1(u) = c - +l(u) " uC " {u) - 

We need to establish the following identities 

(53) [2(l-u 2 )¥ -uC^] = ^(-uC + S 1 ), 

(54) ±{(l-u 2 )Q + Q 1 }y = y(uR 2 + R 1 ). 



Since (|53[) is a matrix identity, by looking at the jfc-place we have 

3 



2(1 - u 2 )V' jk - uC rj ^ jk = -y jk uC kk + %fc_i(£i)fc_i >fc . 



Multiplying both sides by (2 +1 wi^vi fc! i and using (|4"o]l we have 

2(1 - u 2 )-^-Cit) - u(2j + 2,)C{ + _) = -u(2k + 2)Cfr) +2(k + j + 1)C£]_ V 

and by setting A = j + 1 and n = k — j we get 

dC x 
2(1 - u 2 )-^- - m(2A + 1)C£ = -u(2(n + A) + 1)C* + 2(n + 2A - l)C£_x. 
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To see that this identity holds, we use (fBTj) to write -v-f- in terms of C* and C*+l, 
and (|5u) to express C*^ in terms of C* and C^ +1 . Finally we recognize the identity 
(J52l) . Thus we have proved ((53)) . 

Now we need to verify the matrix identity (|54|) . The j/c-entry is given by (see 
(f29| for the definition of the matrices Qo an d <5i) 

|(1 - u a )(Qo)ij+i*j+i,fc + | (Qi)jj_i*j_i,fc = 

u^ jk {Ri)kk + ^j,k+i(Ri)k+i,k + ®j,k-i(Ri)k-i,k- 

Again multiplying both sides by /„ 2 f)j fc! -; and setting A = j + 1 and n = k — j, we 
obtain 

a A 2 (l + A + 1) A+1 (£-A + 2Xn + 2A-l) A _! _ 

I 1 " ; „ i o\ °n-l j °n+l — 



2A 

A (l-n-A + l)(2A- l)(n + A)^ A 
2(n + 2A) 



(2 - (n + A - 1)) (2A - 1)C„ C n+] 



(2A-l)(n + 2A-l) „ A 



^^ ^«C„(«) + 2(A _ 1} '- Cn+m - C* +1 (u) j = 0. 



which is true by ([5 



Now we first use ([5T]) combined with (gSJ) to write C^tJ in terms of C^ and C^ + ^ , 
and then we use (f50f to express C^_ 1 in terms of C* and C„ +1 . Then we get 

(A 2 -lA-3A-ln-2n)(2A-l) ( n ,r,\f„.\ i ( n + 2a ~ 1 ) ^A-l f„A ,oA 



D 

9. Orthogonal Polynomials 

The aim of this section is to build classical sequences of matrix valued orthogonal 
polynomials from our previous work. This means to exhibit a weight matrix W 
supported on the real line, a sequence (P w ) w >o of matrix polynomials such that 
deg(-Pu,) = w with the leading coefficient of P w nonsingular, orthogonal with respect 
to W, and a second order (symmetric) differential operator D such that DP W = 
P W A W where A^ is a real diagonal matrix. Moreover we point out that we also have 
a first order (symmetric) differential operator E such that EP W — P W M W , where 
M w is a real diagonal matrix. 

From D (see Theorem 18. 3[) we obtain a new differential operator D by making 
the change of variables s = (1 — u)/2. Thus 

DF =s(l - s)F" - ( Sl ~ C + sC] F' + A F. 



9.1. Polynomial solutions of DF = XF. 

We start by studying the C f+1 -vector valued polynomials F — F(u) such that 

(55) s(l - s)F" + (B- sC) F' + (A - A) F = XF, 

where 



32 INES PACHARONI, JUAN TIRAO, AND IGNACIO ZURRIAN 



and C, Si and Ao are those matrices given in Theorem 18.31 This equation is an 
instance of a matrix hypergeometric differential equation studied in [Tir03] . Since 
the eigenvalues of B are not in —No the function F is determined by Fq = F(0). 
For | it | < 1 it is given by 

OO j 

(56) F(u) = 2 H 1 ( c -^+ x ;s)F = y £^il B -> C ->- A ° + X ^ F °> F £ C t+ \ 

j=o 3 ' 

where the symbol [B; C; — Ao + A]j is defined inductively by 

[B;C;-A + X] = 1, 

[B;C;-A + A] i+1 = 

(B+j)-\j(C + j - 1) - Ao + X)[B; C; -A + A],, 

for all j > 0. 

Therefore there exists a polynomial solution of (|55]l if and only if the coefficient 
[B; C; — Ao + X]j is a singular matrix for some j £ Z>o- Since the matrix B + j is 
invertible for any j £ Z, we have that there is a polynomial solution of degree w 
of (J5S| if and only if there exists F Q £ C e+1 such that [B; C; -A + X] W F ^ and 
(w(C + w - 1) - A 4- X)[B; C; -A + X] W F = 0. The matrix 

£ 

M w = w(C + w-l)-A a + X = ^((j + w)(j + w + 2) + A)£yj 

3=0 

is diagonal, and ¥„, is a singular matrix if and only if A is of the form — (k + w) (k + 
w + 2) for some k such that < k < £. When this happens the kernel of M w 
is the subspace generated by ek (the vector of the canonical basis {eo, ei, . . . , e£\ 
of C £+1 ). Observe that for every j the subspace generated by {eo, ei, . . . , ej,} is 
invariant by (B — j)~ because it is upper triangular, and that for j < u>, Mj is 
a diagonal matrix whose first k + 1 entries are not zero. Therefore there exists Fq 
such that [B; C: -A + X] W F = e k . Then 

F(u) = 2 H 1 ( C '-^+ x ;u)F 

is a vector polynomial of degree w. Even more, the k-th entry of the solution is a 
polynomial of degree w, and all the other entries are of lower degrees. Hence we 
have the next propositions. 

Proposition 9.1. Given X £ C, the equation DF = XF has a polynomial solution if 
and only if A is of the form —n(n + 2) for n £ No. When this happens, for every 
W > such that n — £ < w < n there is a polynomial solution of degree w, and 
every polynomial solution is a linear combination of these ones. 

Proposition 9.2. Givenw > there exist exactly £+1 values of X such thatDF = XF 
has a polynomial solution of degree W, and for each one of these X 's there is only 
one polynomial solution of degree w up to a scalar and modulo polynomials of lower 
degree. These possible values of X are 

X w (k) = -(k + w)(k + w + 2) 

for < k < £, and the polynomial of degree w corresponding to the eigenvalue X w (k) 
has its k-th entry of degree w, and all the other entries are of lower degrees. 
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9.2. The Inner Product. 

Now, given a finite dimensional irreducible representation 7r = tti of K in the 
vector space V„, let (C(G) ® Find(V 7r )) KxK be the space of all continuous functions 
$ : G — > End(K) such that <f>(k x gk 2 ) = 7r(fci)<%)7r(fc 2 ) for all g G G, fci, fc 2 G if. 
Let us equip V„ with an inner product such that 7r(fc) becomes unitary for all k G K. 
Then we introduce an inner product in the vector space (C(G) <S5 F,nd(V 7r )) KxK by 
defining 

(57) (*i,*a>= /tr(*i( ff )* 2 (s)*)d5, 

where dg denotes the Haar measure of G normalized by J G dg = 1, and $2(9)* 
denotes the adjoint of $2(5) with respect to the inner product in V„. 

Let us write $1 = #1$^, $2 = H 2 ^^ as we did in (O, and put Hi(u) = 
(ho(u), • • • , he(u)Y, H 2 {u) = (fo(u), • • • , fe(u)Y as we did in Subsection 17.21 

Proposition 9.3. J/$i,$ 2 G (C(G) «) End(T4)) KxX t/ien 

1 ^ 

($i,$2) = - / A/l-^V/ijW^Md". 

Proof. Let us consider the element Si = £14 — En G g. Then, as so(4)c — 
s[(2, C) © s[(2, C), ad £a has and ±z as eigenvalues with multiplicity 2. 
Let A = exp REi be the Lie subgroup of G of all elements of the form 

/ cost sin A 

10 

10 

y— sini cost J 

Now Theorem 5.10, page 190 in |Hel84j establishes that for every / G C(G/K) 
and a suitable c* 

/ f(gK) dg K = c,l ( f 5*(a(t))f(ka(t)K) dt) dk M , 

JG/K Jk/M K J-tt ' 

where the function 5* : A — > R is defined by 

*.(<*(*))= n \^mei)\, 

and dgpc and dkj^ are respectively the left invariant measures on G / K and K/M 
normalized by J G/K dgn = Ikim ^m — 1- In our case we have 5*(a(t)) = sin 2 t. 

Since the function g i- > tr(<&i(g)<&2(g)*) is invariant under left and right multi- 
plication by elements in K, we have 

(58) ($ 1; $ 2 ) = c* f sin 2 t tr (*i(o(t))* 2 (o(t))*) dt. 

J — 7T 

Also for each t G [— k, 0] we have that (I - 2(E 1± + E 22 ))a(t)(I - 2(J5n + £22)) = 
o(— t), with / — 2(_En + S22) in K. Then we have 



(59) ($1, $2) = 2c, / sin 2 t tr (*i(o(*))*a(o(*))*) dt. 

Jo 



a(t) = exp ££a 



t G 
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By the definition of the auxiliary function Q^ (g) (see Subsection l2.6[) we have that 
i , i(a(i))$2(a(i))* = Hi(a(t))H2(a(t))* . Therefore, making the change of variables 
cos(i) = u, we have 

,1 I 

($1, $ 2 ) = 2c* / v 7 !-" 2 ^ M«)/j («)**• 

- 1 - 1 j=0 

To find the value of c* we consider the trivial case $i = $2 = I, having so from 
(1571) and 11551) 



^ + 1 = c* / sin 2 i (^ + 1) di, 

then we get c* = ir^ 1 and the proposition follows. □ 

9.3. Our sequence of matrix orthogonal polynomials. 

We take P w = '^^ 1 P W where if? is the matrix polynomial introduced in (|4"5)) and 
P w are the matrix polynomials defined in (1411) . The function \I r_1 is also a matrix 
polynomial as we observed in Remark 18.21 then so is P w . 

Proposition 9.4. The columns {P^,}k=o,...,e of P w are C i+1 -valued polynomials of 
degree w. Even more, for j > k the degree of I P^, J is lower than w, and for j = k 

the degree of ( P^j ) is w. 

Proof. Consider A = — n(n + 2), n > 0. Then P* = i f?~ 1 P!^ are polynomials 
solutions of DF = XF, for (w, k) such that w + k = n. But in the Proposition ^. II 
we have established that the degrees of the polynomial solutions are {n — £,...,n}, 
then, if w' is the degree of P^j we have that n — £ < w' < £. In the other hand P^j 
is a solution for EF = /i w (k)F, where /j, w (k) = u>(| — k) — /s(| + 1). Hence we can 
write P* = Y^j=o u ^ Aj with Aj € C e+1 and we have 

w w 

(uR 2 + Ri) ^V-%- + (M - M*0) Y, u j Aj = 0, 

then 

5] [(jP 2 A, + (j + 1)^1^+1 + (M - M*)Mj] u J ' = 0, 
3=0 
denoting A w i+\ = 0. In particular we have that 

w'R 2 A w , + (M - n w {k))A w , = 0, 
and if we look at the (n — u/)-th entry of this matrix equation, we observe that 

u/(f - (n - «/)) - (n - u/)(| + 1) - m^W = 0, 
because (A w /) n _ w i 7^ (see Proposition I9.2|) . Then 

(i w >(n - w') = /j, w (n - w), 

and necessarily w = w' because of fj, w (n — w) as a function on w £ {n — £, . . . , n} 
is injective. Therefore, P^ is of degree w. The second assertion follows from 
Proposition 19.21 

□ 
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Consider now the sequence of matrix polynomials {Pw(u)} w >o- For each P w (u) 
the k-th column is given by a vector P^{u) associated to the spherical function 

q> (w-l/2,-k+l/2) 

Recall that $(™- < V 2 >- fc + £ / 2 ) = UT(u)yP*(u)$*(u), then PropositionEStells us 
that 



,^(w-l/2-k+l/2) ^(w' -1/2 -k 1 +1/2), 

2 f 1 



y/1 - u 2 [UT(u)y?*(u)}*lUT(u)y?%,(u)} dr, 
" J-i 

hence, 

1 P*{u)*W{u)P«{u)dr = ($ (^A-W) i$ K^A-*'+^) ); 
-l 

where 

(60) W(u) = -\J\- u 2 ^*T*{u)U*UT{u)^. 

IT 

Therefore P^ and P*, are orthogonal with respect to W if (w,k) 7^ (w',k'), since 
using Schur's orthogonality relations it follows that non equivalent spherical func- 
tions are orthogonal with respect to the inner product (|57|) . 

Theorem 9.5. The sequence (P w )w>o * s o- n orthogonal sequence of matrix valued 
polynomials with respect to W, such that 

DP W = P w k w and EP W = P W M W , 

where A w = J2k=Q ^w(k)E kk , and M w = J2k=o Vw(k)E kk , with 

\ w {k) = -{w + k)(w + k + 2) and fi w (k) = u>(§ - k) - fe(| + 1). 
Proof. Given w and w', non negative integers we have 

,1 t ,1 



(P W ,P W >}= I P w {u)*W{u)P w ,{u)dr= V £ fe , fc , / P£(u)*W(u)P#(u)dr 
- 7 - 1 fe,fc'=o J - 1 

1 r 1 

= J2 E k,k'Sw,w>Sk,k> P*(u)*W(u)P^,(u)dr 

k,k'=0 J- 1 

1 r 1 

>J2 E ** P*(uyW{u)P*,{u)dr, 

l — n J — X 



w,w' 

k=0 



then orthogonality is proved. As we have established in Proposition 19.41 P* (u) is 
a polynomial of degree w, and for j > k the entries (P^,(u))j are of lower degrees, 
therefore P w (u) has a non singular leading coefficient. For the last assertion recall 
that each column P^ (u) is an eigenfunction of the operator D and E introduced 
in Theorem 18.31 with respective eigenvalues A„,(fc) = — (w + k)(w + k + 2) and 

Mfc) = u;(f-fc) -*(§ + !). D 
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